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Local-in-time Adjoint-based Method for Optimal 
Control/Design Optimization of Unsteady 
Compressible Flows 


N. K. Yamaleev,*B. Diskin, ^and E. J. Nielsen* 


We study local-in-time adjoint-based methods for minimization of flow matching func- 
tionals subject to the 2-D unsteady compressible Euler equations. The key idea of the 
local-in-time method is to construct a very accurate approximation of the global-in-time 
adjoint equations and the corresponding sensitivity derivative by using only local infor- 
mation available on each time subinterval. In contrast to conventional time-dependent 
adjoint-based optimization methods which require backward-in-time integration of the ad- 
joint equations over the entire time interval, the local-in-time method solves local adjoint 
equations sequentially over each time subinterval. Since each subinterval contains rela- 
tively few time steps, the storage cost of the local-in-time method is much lower than that 
of the global adjoint formulation, thus making the time-dependent optimization feasible 
for practical applications. The paper presents a detailed comparison of the local- and 
global-in-time adjoint-based methods for minimization of a tracking functional governed 
by the Euler equations describing the flow around a circular bump. Our numerical results 
show that the local-in-time method converges to the same optimal solution obtained with 
the global counterpart, while drastically reducing the memory cost as compared to the 
global-in-time adjoint formulation. 


I. Discrete Optimal Control Problem 


We consider time-dependent optimization problems that include both optimal control and shape/design 
optimization of unsteady compressible flows governed by the 2-D Euler equations. The governing equations 
are discretized by using a node-centered finite- volume scheme, where solution values are stored at the mesh 
nodes. Inviscid fluxes at cell interfaces are computed using the upwind scheme of Roe. 1 The discretized 
Euler equations including the boundary conditions can be written in the following form: 


Q n - Q”- 1 

At 


+ R” = 0, 


( 1 ) 


where Q = f v U dV, U is a vector of the conserved variables, V is the control volume, and R is the spatial 
undivided flux residual. It should be noted that the above discrete formulation (1) is very general and can be 
directly applied to the unsteady Reynolds-averaged Navier-Stokes equations. In Eq. (1), the time derivative 
has been approximated using the implicit first-order backward-difference (BDF-1) formula. Note that 2nd- 
and 3rd-order BDF formulae can also be used in the present formulation with minor modifications. 2 

The discrete time-dependent optimization problem is formulated as follows: 


/ min F obj (D), F obj (D) = £ /"(Q",D)Ai 

< D eT>a 71=1 (*) 

{ s.t. Eq. (1), 
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where D is a vector of the control or design variables which may depend on time, T> a is a set of admissible 
controls, which depends on specifics of the target physical system and ensures the existence of a solution of the 
optimization problem, N is the total number of time steps, Q is the solution of the unsteady, compressible 
Euler equations (1), E 0 bj is an objective functional. The minimization problem (2) is very general and 
directly applicable to both active flow control and aerodynamic design optimization of unsteady flows. 
Similar optimal control and design optimization problems governed by the unsteady incompressible and 
compressible Euler/Navier-Stokes equations have been considered in. 3-9 

To reduce the complexity of the optimization problem (2), without loss of generality, it is assumed that 
the objective functional Eobj is a scalar quantity. In the present analysis, we consider the following discrete 
convex functional at each time level: 

j?n _ (jn ^^ytarget 

je r c 3 3 

where Cj is an aerodynamic quantity such as lift or pressure on the controlled boundary surface T c , C'j arget 
is a given target value of Cj. In the present paper, only matching objective functionals given by Eq. (3) are 
considered. 



II. Global-in-time Adjoint-based Optimization Method 


The discrete time-dependent optimization problem (2) is solved by using the method of Lagrange mul- 
tipliers which is used to enforce the governing equations and the corresponding boundary conditions (1) as 
constraints. The discrete Lagrangian functional is defined as follows: 

L(D,Q,A) = £ /"At + E [A"] T ( Qn -^ U ~ 1 +R ra ) A t+ [A 1 ] 7 (Q 1 - Q in ) , (4) 

71=1 77=2 V ' 


where A is a vector of Lagrange multipliers or costate variables, n = 1 corresponds to the initial moment 
of time, Q ln is the initial condition for the Euler equations, /” is the objective functional given by Eq. (3), 
and R n = R(Q", D) is the spatial undivided residual. Note that the scalar product of the costate vector 
and the flux residual vector in Eq. (4) can be interpreted as the integral over the computational domain. 

The sensitivity derivative is obtained by differentiating the Lagrangian with respect to D, which yields 
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Regrouping the terms, Eq. (5) can be recast as follows: 
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( 6 ) 


For aerodynamic design optimization and optimal control problems, the number of design or control variables 
may be very large. Therefore, the computation of 9Q/9D is extremely expensive in terms of the CPU time, 
because it requires as many solves of the primary problem as the total number of the design/control variables 
involved. To eliminate this term from the Lagrangian, the second, third, and forth terms on the right hand 
side are set equal to zero, thus leading to the following adjoint equations for determining the Lagrange 
multipliers: 
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The main advantage of the adjoint formulation is that at each optimization iteration, the adjoint equations 
(7) do not depend on D and should be solved once regardless of the number of the control/design variables. 
Equations (7) represent a linear system of equations for the adjoint variables, which are solved backward in 
time. Using the Lagrange multipliers found from Eqs. (7), the sensitivity derivative is calculated as follows: 
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where jjjj- and 4^- are calculated by using Q n stored during the forward sweep in time. 

A minimum of the functional is found by using the steepest descent method in which each step of the 
optimization cycle is taken in the negative gradient direction 

D[ +1 =D[-6 k (J^y (9) 

where 8k is an optimization step size which can be chosen adaptively, k is the number of optimization 
cycle, D l is an Z- th component of the vector the control/design variables, D. Note that for optimal control 
problems considered herein, D l denotes the value of the control variable at the Z-th time step, so that the 
dimensionality of the vector D is equal to the total number of time steps used for integration of the flow 
equations. The sensitivity derivative dL/dDi in Eq. (9) is determined using Eq. (8) which requires the 
solution of the adjoint equations (7). During the solution of the adjoint equations which are integrated 
backward in time, the sensitivity derivative at each time step is computed and added to its value at the 
previous time step. At n = 1, the complete sensitivity derivative vector is available and used in Eq. (9) for 
calculating a new value of each control variable D k+1 . Then, the entire optimization cycle is repeated until 
\D l k , 1 — D l k | < e for all Z, where e is a given tolerance. The above procedure can be summarized in the form 
of the following global-in-time adjoint-based algorithm: 

ALGORITHM 1. 

1. Choose 8, Di; set k = 1 and ^ = 0. 

2. Solve Eq. (1) for Q£ for n = 1, N and store Qj., . . . , Qj^. 

3. Solve Eq. (7) backward in time for AjJ , n = 1, N. 

4. Evaluate using Eq. (8). 

5. Calculate D l k+1 using Eq. (9) for all Z. 

6. If||D‘ +1 -D* || > e, set k = k + 1 and go to (2); otherwise stop. 


III. Local-in-time Adjoint-based Optimization Method 

As has been mentioned in the foregoing section, at each iteration of the global-in-time adjoint-based 
optimization method, the flow equations are integrated forward in time while the adjoint equations are 
integrated backward in time over the entire time interval considered. Since the adjoint equations (7) depend 
on Q™, the solution of the flow problem has to be stored for all time levels over which the optimization 
problem is solved. For realistic 3-D large-tinre optimal control problems, these storage requirements can 
quickly become prohibitive. This motivates us to use suboptimal strategies to reduce the memory cost of 
the global-in-time adjoint-based optimization procedure presented in the foregoing section. 

We begin by dividing the entire time interval into M subintervals such that 0 = T\ < ... < Tm+ i = 
N At = Tfinai, where T m = A tN m , M < N , and At is the time step used for integrating the flow and 
adjoint equations. In general, this partitioning can be chosen so that each subinterval contains one or several 
time steps of the time-marching scheme used for solving the flow equations. The main idea of the proposed 
suboptimal strategy is based on the observation that the sensitivity derivative of the the global-in-time 
Lagrangian can be represented as a sum of the sensitivity derivatives of local-in-time functionals: 
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where the local Lagrangian functionals are defined as 


^ m -\- 1 Nm -{- 1 

E /"At+ E 

jrn __ J n=AT m + l n=iV m + l L 


Q n -Q n 

At 


N 2 


E FAt + E 

n— 1 n=2 L 


n 2 1? 


Q n -Q n 

At 


+ R n J At, for 2 < m < M 
,1 T 


R" At ■ 


(q 1 - Q in ) , 


( 11 ) 


for to = 1, 


Q and A are local conserved and adjoint variables defined on the subinterval (T m ,T m+ 1 ] , accordingly. 

The local-in-time sensitivity derivatives dL m /dD , m = 1, M can be evaluated by using an adjoint-based 
approach similar to one described in the foregoing section. Differentiating each local Lagrangian, L m , with 
respect to D, collecting the <9Q"/(9D terms and setting their coefficients equal to zero yield the following 
local flow adjoint equations for the subinterval (T m , T m+ i]: 
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( 12 ) 


Note that the last equation in Eq. (12) is used only on the first subinterval [Tj, T 2 ] corresponding to to = 1. 
Furthermore, if the local adjoint equations (12) are derived solely based on the local-in-time Lagrangian L m 
itself, i.e. , no information about the global-in-time Lagrangian is invoked, then A in Eq. (12) is identically 
equal to zero. With the local adjoint variables A satisfying Eq. (12), the local sensitivity derivative on the 
subinterval (T m ,T m+ i] is calculated as follows: 


dL m 

~dD 



(13) 


The local sensitivity derivative at the m-th time subinterval is calculated using Eq. (13) and added to 
the sum of the sensitivity derivatives obtained at the previous (to — 1) subintervals in accordance with Eq. 
(10). Once the global sensitivity derivative is available at the last M-th time subinterval, the vector of 
control/design variables is updated by using the steepest descent method as follows: 

D fc+1 = D fc - <J fc , (14) 

where k is the number of an optimization iteration, and 5k is the optimization step size which is chosen 
adaptively at each optimization cycle. The steepest descent iterations are repeated until ||Dfc+i — D^|| < e, 
where e is a user-specified tolerance. 

Comparing Eq. (7) with Eq. (12) and Eq. (8) with Eqs. (10, 13), the following important conclusions can 
be drawn. First of all, each local-in-time set of the adjoint equations (12) defined on a given time subinterval 
is independent of the other adjoint equations defined on the rest of the time interval [0, Tg na i], thus indicating 
that the local adjoint equations (12) can be solved sequentially starting from m = 1 and marching forward 
one subinterval by another up to m = M . It should be emphasized that within each subinterval ( T m , T m+ 1 ], 
the local adjoint equations (12) have to be integrated backward in time. The local sensitivity derivatives 
calculated on each subinterval using Eq. (13) are then summed up to give the sensitivity derivative for the 
entire time interval [0,Tg na i]. Note that the flow adjoint variables obtained with the local adjoint equations 
(12) for to = 1, M and the corresponding total sensitivity derivative given by Eq. (10) are not equal to those 
of the global- in-time formulation Eqs. (7, 8), i.e., A^ Aon (T m , T to +i], where A denotes the solution of the 
global adjoint equations (7). Though the above approach only approximates the original global sensitivity 
derivative given by Eqs. (7, 8), it reduces the memory cost by a factor of M as compared with the global- 
in-time formulation. Indeed, since the local adjoint equations on each time subinterval ( T m ,T m+ i ] can be 
solved independently on the adjoint equations defined on the other subintervals, only the flow solutions for 
the current subinterval, Q = • • • , Q Nm+1 ) T , have to be stored, thus drastically reducing the memory 

cost. 
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The second observation resulted from the comparative analysis of Eqs. (7,8, 12, 13) is that the set of the 
local adjoint equations (12) for m = 1, M is identical to the global adjoint equations (7) if A in Eq. (12) is 
set to be A JVm+1+1 . In spite of the fact that this approach provides complete consistency of the local and 
global adjoint equations, it destroys the locality of the adjoint equations (12) defined on each subinterval 
and therefore requires the same storage as the original global-in-time formulation. 

The above considerations suggest that A in Eq. (12) should be chosen such that it preserves the locality 
of the local-in-time adjoint equations on each subinterval (T m ,T m+ 1 ] and provides a good approximation of 
A -V ”+i + i. To satisfy these constraints, we have chosen A in the following form: 


Afc 


= A 


JV m+ i+l 

fc-i 


(15) 


where k is the number of an optimization iteration. In other words, the required vector of adjoint variables 
at the time level N m+ 1 + 1 is taken from the previous iteration of the steepest descent method (14). This 
choice of A significantly reduces the memory cost as compared to the global-in-time adjoint formulation. 
Indeed, in this case, the flow solution should be stored only at those time levels that belong to the current 
time subinterval (T m ,T m+ 1 ]. In addition, M adjoint variables, A^( n 1 +1+1 for to = 1 , M, from the previous 
optimization cycle should also be stored, as follows from Eq. (15). Therefore, the overall memory cost of 
the proposed methodology is 0(N/M + M) versus the O(N) cost of the global-in-time formulation. This 
estimate suggests that the optimal value for the number of time subintervals is M = y/N, where N is the 
total number of time levels. Another advantage of this method is that if the steepest descent method (14) 
converges, then the solution of the set of the local-in-time adjoint equations approach to the solution of the 
original global adjoint equations, thus providing full consistency of the local to global formulations. 

The above local-in-time strategy for solving the minimization problem (2, 3) can be formulated in the 
form of the following algorithm: 

ALGORITHM 2. 


1 . 

2 . 

3. 

4. 

5. 

6 . 
7. 


Choose 6, Di, and M ; set to = 1, k = 1, A^ m+1 = 0 for to = 1, M, and ^ = 0. 
Solve Eq. (1) for Qf m+1 , . . . , Qf m+1 . 

Solve Eq. (12) with A = backward in time to find A^ m+1 , . . . , A^ m+1 . 

Store A^ m+1 . 

Evaluate using Eq. (13). 

q p i dL dL i dL m 

dD ~ dD dD • 

Set m = m + 1, if to < M go to step (2); otherwise continue. 


8. Calculate Dfc + i using Eq. (14). 

9. If HDfc+i — D fc || > e set to = 1 , k = k + 1 , ^ = 0 and go to (2); otherwise stop. 

It should be noted that the above local-in-time adjoint-based algorithm can be directly used for solving both 
time-dependent optimal control problems whose control variables depend on time and design optimization 
problems whose design variables are independent of time. This is the key difference between the local-in-time 
method and the locally optimal scheme and its variants (e.g., see Refs. [ 3 ’ 4 ]), which are applicable only to 
optimal control problems, but cannot be used for design optimization. One of these locally optimal control 
strategies, which is also known as a receding horizon control technique, is presented next. 


IV. Locally Optimal Control Strategy 

In this section, the minimization problem (2) is interpreted as an optimal control problem with the 
following control variables D = [D 1 , . . . D N ] T , where N is the total number of time steps used for integration 
of the governing equations (1). Similar to the local- in-time approach presented in the foregoing section, we 
divide the entire time interval into M subintervals: 0 = T\ < ... < Tm + i = N At = Tfi na p Along with 
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the PDE-constrained global optimal control problem (2), we consider the following M local-in-time optimal 
control problems: 


^ ^ Nm- 1-1 

. . min i^j(D), F 0 -( D) = £ / n (Q",D)Ai 

nev a , te(T m ,Tm+i] n =N m 

s.t. Eq. (l) on ^2^27 with, the mitml condition Q !n = Q N ” 


(16) 


where N m = 1 if to = 1 otherwise N m = N m + 1, T m = N m At, At is the time step of the time-marching 
scheme used for solving the flow equations, D = (Djy- , . . . , -Ebv m+1 ) is the subset of the control variables 
that belong to the time interval (T m ,T m+ 1 ], Q is the solution of the Euler equations over the subinterval 
{T m , T m+ i 

The local optimal control problems are solved sequentially over each time subinterval using the solution 
from the previous subinterval as an initial condition. To solve each local control problem (16), we use an 
adjoint-based gradient method similar to one described in Section II. The discrete Lagrangian for the local 
optimization problem, the corresponding local adjoint equations, and the local sensitivity derivative on the 
interval (T m ,T TO+ i] are identical to those used for the local-in-time adjoint-based method and given by Eqs. 
(11), (12), and (13), respectively. The locally optimal algorithm can be formulated as follows: 

ALGORITHM 3. 

1. choose 6k and M; set m = 1, k = 1, and = 0; 

2. Choose T>f m ,...,T)f m+1 . 

3. Solve Eq. (1) for Qf m , . . . , Qf m+1 . 

4. Solve Eq. (12) with A = 0 backward in time to calculate A^ m , . . . , A^ m+1 . 

5. Evaluate AA using Eq. (13). 

6. Set D% +1 = for N m < n < N m+1 . 

7. If 3n : | D% +1 — D^\ > e then set k = k + 1 and go to (3); otherwise continue. 

8. Set to = to + 1, if to < M go to step (2); otherwise stop. 

In spite of some similarities between Algorithms 2 and 3, there is one major difference, namely, how 
local-in-time and locally optimal methods update the control variables. The local-in-time method uses the 
local adjoint equations (12) to evaluate the global sensitivity derivative on [0,Tfi na i], which provides a search 
direction in the entire design space and drives the control variables to a minimum of the global-in-time 
objective functional (2). In contrast to the local- in-time method, the locally optimal technique sequentially 
solves each local optimization problem (16), which is equivalent to finding a minimum of the local objective 
functional in the design subspace of a much smaller dimension. The global solution on the entire time interval 
[0, Tfi na i] is obtained by patching together all the local optimal control solutions (Q m ,D m ), to = 1 ,M. In 
general, the locally optimal solution Q m may not be equal to the solution of the global-in-time optimization 
problem Q“, n = N m ,N m+1 on the same time subinterval. Therefore, Q m is suboptimal with respect 
to the original time-dependent optimization problem. However, for the class of flow matching problems 
considered in this paper, the the locally and globally (in time) optimal adjoint-based methods converge to 
the same optimal solution. The main advantage of the locally optimal strategy is its efficiency. Indeed, a 
local optimization problem on each time subinterval is M times smaller as compared to the original problem, 
thus drastically reducing the memory cost if M is large. The locally optimal strategy can be used even if 
each subinterval consists of a single time step; such optimization method is hereafter termed a “one-step” 
method. In this case, the original time-dependent optimization problem is replaced with a sequence of 
stationary optimal control problems. 

In Ref. [ 3 ], it has been proven that the locally optimal control strategy similar to one described above 
converges to the solution of the global-in-time optimal control problem governed by the incompressible 
Navier-Stokes equations. Although, similar proof is not currently available for the compressible Euler and 
Navier-Stokes equations, our numerical results presented in the next section show that the locally optimal 
control strategy works very well for the tracking functional Eq. (2) at supersonic flow regimes. 
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V. Numerical Results 


We consider simple unsteady compressible inviscid flows in a channel with a bump to evaluate the perfor- 
mance of the local-in-time and locally optimal methods for design optimization and flow control problems. 
For all test problems considered, the freestream Mach number is given by 

M(t) = M 0 + AM cos (ut), (17) 

where Mq is a mean value of the freestream Mach number, AM and uj are an amplitude and frequency 
of freestream Mach number oscillations. Since the freestream Mach number oscillates in time, the entire 
flowfield is essentially unsteady. 



Time 

Figure 1. Comparison of the optimal Mach number distributions computed with the one-step and global-in- 
time methods for the optimal flow control problem. 

The test problems are solved on structured grids using a node-centered finite volume code that is first- 
order accurate both in time and space. At each time step, the nonlinear discrete flow equations are solved by 
using the Newton’s method. For each test, the Euler equations and their adjoints are converged to machine 
precision. The local adjoint equations are integrated backward in time and require the solution of the Euler 
equations to be known only for a current time subinterval which is much smaller that the entire time interval. 
In the present implementation of local optimal and suboptimal methods, only the local unsteady solution 
set on the current time subinterval is held in operating memory, while for the global-in-time optimization 
method, the entire unsteady solution history for all time levels has to be stored. The derivatives of R and 
/ with respect to Q and D, which are required to form the adjoint equations and the sensitivity derivative, 
are calculated using the complex variable formula proposed by Lyness. 10 

A. Optimal Flow Control 

First, we validate the implementation of the locally optimal method and test its performance for a time- 
dependent optimal flow control problem given by Eq. (2). For this test case, the thickness of a circular 
bump is set to be 10% of its chord length, and the final time, Tg na i, is 1. The target solution is computed by 
using the following parameters in Eq. (17): Mo = 2, AM = 0.5, and to = 177t/ 9. The objective functional 
is given by 

r = £ [p;-(p; arget ) n ] 2 , (is) 

je r c 

where P” and (pj’ arget ) are computed and target time-dependent pressure profiles at the lower boundary 
of the computational domain. Values of the freestream Mach number at each time step D = (Mi, . . . , Mjv) t 
are used as control variables. Both the locally optimal and global-in-time optimization procedures start 
at a constant freestream Mach number which is set equal to 2.1 for all time levels. The optimization is 
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Figure 2. Histories of convergence of the one-step and global-in-time adjoint-based optimization methods. 

stopped when either the relative change in the value of each control variable becomes smaller than 10 ” 4 
or the absolute value of the normalized objective functional f m (JD)/(N m+ i — N m ) becomes smaller than 
10”'. In contrast to the global-in-time procedure, the one-step method solves the adjoint equations over 
one time step, so that only the flow solutions at the current and previous time levels should be stored, thus 
drastically reducing the memory cost. Note that the computational cost of the global-in-time method per 
each optimization cycle is N times larger than that of the one-step scheme, where N is the total number of 
time steps. 

To compare the one-step and global-in-time adjoint-based optimization procedures and to evaluate accu- 
racy of each method, the suboptimal and optimal Mach numbers are compared with the target Mach number 
in Figure 1. As seen in the figure, both methods converge to the target solution on the entire time interval 
considered, thus validating the one-step and global-in-time adjoint formulations. Note, however, that the 
one-step strategy provides higher accuracy than its counterpart. 

The histories of convergence obtained with both optimization techniques are presented in Fig. 2. For the 
one-step method, the value of the objective functional drops by an order of magnitude every 3 optimization 
cycles. Only 6 optimization iterations are needed to reduce the objective functional by two orders of magni- 
tude. The total number of optimization cycles required for convergence of the global-in-time method is an 
order of magnitude larger than that of the one-step strategy. In spite of the fact that the combined number 
of optimization iterations of the one-step method for all time levels is approximately the same as the total 
number of optimization iterations performed by the globally optimal method, each iteration of the one-step 
method is N times cheaper than that of its counterpart. For N = 11 used in this test case, the total CPU 
time is reduced by about an order of magnitude as compared with the global adjoint-based formulation. This 
is because at each iteration of the one-step method, the local control problem is solved over one time step, 
while for the global-in-time method, the flow and adjoint equations are integrated over N time levels. Note 
that for practical applications that require 10 3 — 10 4 time steps to resolve the unsteady flow dynamics, the 
one-step method can provide three to four orders of magnitude reduction in the CPU time and memory cost 
as compared with its conventional counterpart. To illustrate how the lift coefficient converges to its target 
value, the optimal Cl obtained with one-step and global- in-time methods as well as the initial and target lift 
coefficients are presented in Figure 3. The difference between the initial lift coefficient and its target value is 
of the order of 0(1), while the solutions obtained with the one-step and global-in-time methods are almost 
indistinguishable from the target Cl over the entire time interval considered. 
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Target 



Figure 3. Comparison of the optimal lift coefficients computed using the one-step and global-in-time methods 
with their initial and target values. 


B. Design Optimization 

The second test problem has been chosen to evaluate the performance of the local-in-time method for a 
shape optimization problem given by Eq. (2). The bump shape is described by the following equation: 

y = d\tpi (x) + d 2 i> 2 (x) + d 3 V>3 (x), 

where ijji(x), i = 1,3 are given polynomials satisfying the requirement that the leading and trailing edges 
of the bump continuously meet the straight lower wall on either side of the bump. The three coefficients 
di, c?2, and d 3 are design variables, i.e. , D = [d\, d 2 , d^\ T . The objective functional is the same as the one 
used in the previous test problem. Similar to the previous example, the freestream Mach number varies in 
time, according to Eq. (17) with Mq = 2, AM = 0.2, and u = 177 t / 9 . The target pressure distribution is 
obtained by solving the unsteady 2-D Euler equations with the bump parameters/design variables chosen 
to be d\ = 0.05, cfe = 0.03, and d% = 0.01. The initial value of the design variables are set to be zero., 
i.e., initially, there is no bump on the lower wall. Note that the target flow and bump shape parameters 
are feasible, and the objective functional vanishes at the optimum; this information is used to monitor the 
performance of the local and global-in-time optimization methods. The number of time subintervals used 
in the local-in-time optimization procedure is set to be equal to 5, i.e., each interval consists of only two 
time steps. The results presented hereafter have been obtained using the simplified form of the local-in-time 
method with A = 0 in Eq. (12). 

Histories of convergence of the objective functional obtained with the local- and global-in-time methods 
are presented in Fig. 4. Overall, both methods demonstrate a similar convergence rate. The value of the 
objective functional monotonically decreases until it becomes less than the specified tolerance which is set to 
be 10“ 6 . About 50 design cycles are needed to reduce the objective functional by five orders of magnitude. 
It should be noted that the local-in-time method demonstrates much faster convergence during the first 
several cycles than its counterpart. Figure 5 shows convergence histories of all three design variables during 
optimization. The most important conclusion that can be drawn from this comparison is that the local- 
and global-in-time methods converge to the same solution. From this standpoint, the solution obtained 
with the local-in-time method is optimal with respect to the original optimization problem (2). It should 
also be noted that all the design variables approach to their target values. In spite of the fact that the 
second bump parameter, d 2 , is slightly overpredicted while the third one, cfe, is underpredicted, the optimal 
shape is practically indistinguishable form the target bump, as one can see in Fig. 6. Form the comparisons 
presented above it follows that the locally optimal method does not only converge to the same optimal 
solution computed using the global-in-time method, but also reduces the memory cost by a factor 5 as 
compared with its conventional counterpart. 
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Figure 4. Convergence of the objective functional obtained with the local- and global-in-time methods for the 
design optimization problem. 
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dl, global method 



Figure 5. Convergence of the design variables obtained with the local- and global-in-time methods for the 
design optimization problem. 



Figure 6. The target and computed bump shapes. 
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